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This listing of claims will replace all prior versions, and listings, of claims in the application. 
Listing of Claims: 

1 . (Currently Amended) A method for obtaining predicted user satisfaction data 
regarding the performance of a search mechanism for a computer which provides search 
results in response to user queries, the method comprising: 

storing interaction of users with the search results obtained in response to a query; 
determining at least one predictive pattern model for predicting user-satisfaction with 
the search results from the stored interaction of multiple users with the search results to 
improve the quality of search results , wherein determining at least one predictive pattern 
model comprises: 

running a pre-iudged set of results through the search mechanism; 

applying a candidate predictive pattern to context-based user behavior data for 

the pre-iudged set of results; 

comparing resulting predicted user satisfaction data with judged satisfaction 
for the pre-iudged set of results; and 

if the candidate predictive pattern is successful at determining a predicted user 
satisfaction corresponding to the pre-iudged user satisfaction, selecting the 
candidate predictive pattern as one of the at least one predictive pattern model; 
storing the at least one predictive pattern model; and 

applying said predictive pattern model to context-based user behavior data to 
determine a satisfaction value for the users with queries that indicate the satisfaction of the 
users with the search results, wherein the context-based user behavior data comprises user 
feedback data and context data associated with users feedback data, the context-based user 
behavior data acquired after receipt by users of the search results of said application of said 
predictive pattern model further comprises isolating a set of said performed queries which are 
unsatisfactory and which share a common characteristic in order to identify problems which 
appear for multiple users or queries. 
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2. (Previously Presented) The method of claim 1, where said storing at least one 
predictive pattern model comprises utilizing data mining techniques to determine at least one 
predictive pattern model for user satisfaction. 

3. (Previously Presented) The method of claim 1, where said context-based user 
behavior data comprises explicit user feedback data. 

4. (Previously Presented) The method of claim 1, where said context-based user 
behavior data comprises implicit user feedback data. 

5. (Previously Presented) The method of claim 4, where said context-based user 
behavior data is selected from the group comprising: user navigation to a new page using a 
hyperlink; user navigation to a new page using a history list; user navigation to a new page 
using an address bar; user navigation to a new page using a favorites list; user scrolling 
behavior; user document printing behavior; user adding a document to said favorites list; user 
switching focus to a different application; user switching focus back from a different 
application; user closing a window; user dwell time behavior; user initiation of a new query; 
sequences of user behaviors; and user inactivity without switching focus from a window 
relating to said performed query. 

6. (Previously Presented) The method of claim 1, where said application of said 
predictive pattern model yields predicted user satisfaction data regarding said search 
mechanism, and where said method further comprises: 

displaying said predicted user satisfaction data. 

7. (Cancelled) 

8. (Original) The method of claim 1, where said context-based user behavior data 
comprises a testing set of context-based user behavior data. 

9. (Cancelled) 
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10. (Currently Amended) A system for obtaining predicted user satisfaction data 
regarding the performance of a search mechanism for a computer which provides search 
results in response to user's queries, the system comprising: 

storage for storing interaction of users with the search results obtained in response to a 

query; 

a processor for determining at least one predictive pattern model for predicting user 
satisfaction with the search results from the stored interaction of multiple users with the 
search results to improve search qualit y, wherein the at least one predictive pattern model is 
determined by: 

running a pre-iudged set of results through the search mechanism ; 

applying a candidate predictive pattern to context-based user behavior data for 

the pre-iudged set of results; 

comparing resulting predicted user satisfaction data with judged satisfaction 
for the pre-iudged set of results; and 

if the candidate predictive pattern is successful at determining a predicted user 
satisfaction corresponding to the pre-iudged user satisfaction, selecting the 
candidate predictive pattern as one of the at least one predictive pattern model ; 
storage for storing at least one predictive pattern model; and 

data mining apparatus for applying said predictive pattern model to context-based 
user behavior data, said context-based user behavior data comprising user feedback data and 
context data associated with the user feedback data, the context-based user behavior data 
acquired after receipt by users of the search results of said application of said predictive 
pattern model further comprises isolating a set of said performed queries which are 
unsatisfactory and which share a common characteristic in order to identify problems which 
appear for multiple users or queries. 

1 1 . (Previously Presented) The system of claim 10, where said predictive pattern model 
is derived from the use of data mining techniques to determine at least one predictive pattern 
model for user satisfaction. 
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12. (Previously Presented) The system of claim 10, where said context-based user 
behavior data comprises explicit user feedback data. 

13. (Previously Presented) The system of claim 10, where said context-based user 
behavior data comprises implicit user feedback data. 

14. (Previously Presented) The system of claim 13, where said context-based user 
behavior data is selected from the group comprising: user navigation to a new page using a 
hyperlink; user navigation to a new page using a history list; user navigation to a new page 
using an address bar; user navigation to a new page using a favorites list; user scrolling 
behavior; user document printing behavior; user adding a document to said favorites list; user 
switching focus to a different application; user switching focus back from a different 
application; user closing a window; user dwell time behavior; user initiating a new query; 
sequences of user behaviors; and user inactivity without switching focus from a window 
relating to said performed query. 

15. (Original) The system of claim 10, where said data mining apparatus produces 
predicted user satisfaction data regarding said search mechanism, and where said method 
further comprises: 

displaying said predicted user satisfaction data. 

16. (Original) The system of claim 10, where said data mining apparatus further isolates 
a set of said performed queries which are unsatisfactory and which share a common 
characteristic. 

17. (Original) The system of claim 10, where said context-based user behavior data 
comprises a testing set of context-based user behavior data. 

18. -24. (Cancelled) 
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25. (Currently Amended) A system for real-time optimization of a search mechanism for 
a computer which provides search results in response to user queries, comprising: 

means for storing satisfaction of users with search results that is determined by an 
evaluation of the search results by the user; 

means for storing interaction of users with the search results obtained in response to a 

query; 

means for determining at least one predictive pattern model for predicting user 
satisfaction with the search results based on the satisfaction of the user stored in the means 
for storing and the user interaction stored in the means for storing multiple users interaction 
to improve search qualit y, wherein the at least one predictive pattern model is determined by: 

running a pre-iudged set of results through the search mechanism ; 

applying a candidate predictive pattern to context-based user behavior data for 

the pre-iudged set of results; 

comparing resulting predicted user satisfaction data with judged satisfaction 
for the pre-iudged set of results; and 

if the candidate predictive pattern is successful at determining a predicted user 
satisfaction corresponding to the pre-iudged user satisfaction, selecting the 
candidate predictive pattern as one of the at least one predictive pattern model ; 
means for storing at least one predictive pattern model; 

means for applying said predictive pattern model to context-based user behavior data 
comprising user feedback data and context data associated with user's feedback data, the 
context-based user behavior data acquired after receipt by a user of the search results of said 
application of said predictive pattern model further comprises isolating a set of said 
performed queries which are unsatisfactory and which share a common characteristic in order 
to identify problems which appear for multiple users or queries; and 

means for outputting predicted user satisfaction data which is indicative of a level of 
satisfaction experienced by user's users of search results returned by the search mechanism, 
the outputted predicted user satisfaction data based on the application of said predictive 
pattern model. 
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26. (Cancelled) 

27. (Previously Presented) The method of claim 1, further comprising isolating 
problematic queries based on the predicted user satisfaction data. 

28. (Previously Presented) The method of claim 1, further comprising generating a 
summary of measured satisfaction based on the predicted user satisfaction data. 

29. (Previously Presented) The method of claim 1, further comprising monitoring a 
search mechanism responsive to the predicted user satisfaction data. 
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